IMAGE DISPLAY METHOD, APPARATUS AND STORAGE MEDIUM 

BACKGROUND OF THE INVENTION 
Field of the Invention 
5 The present invention relates to an image display method, 

apparatus and storage medium, and more particularly to an image 
display method wherein a plurality of images are displayed on 
a CRT, LCD, etc. monitor according to a predetermined display 
layout, apparatus, and a computer- readable storage medium on 
10 which a program that causes a computer to execute the steps of 
the image processing method. 

Description of the Related Art 
There are in use in the medical field today apparatus 
(modalities) for forming X-ray and other diagnostic images used 
15 in a variety of diagnosis, including CR (computed Radiography) 
apparatus, CT (Computerized Tomography) apparatus, MRI (Medical 
Resonance Imagery) apparatus, etc. The image data produced in 
each modality is displayed on a CRT terminal (hereinafter 
referred to simply as a CRT) , or output by a laser printer, etc. 
20 to film, etc. for use by a reader at a medical treatment site 
in ascertaining the presence or absence of a disease, tissue 
damage, etc. 

In order to make images obtained by such modalities easy 
to use in diagnosis, it is necessary to display the images on 
25 a display means. At any rate, because a plurality of images are 
obtained in a single examination employing CT apparatus, MRI 
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apparatus, etc., to provide for easy examination of such images 
it is necessary to line them up. In addition, when employing 
in diagnosis images obtained by CT apparatus, there are cases 
for which images acquired in the past are compared to images 
5 acquired in the present in a comparative diagnosis, and to 
facilitate easy performance of such comparison diagnosis it is 
necessary to line the images up and display them. 

To this end, a display protocol is employed for defining 
the display format in which a plurality of images is to be 

10 displayed, and based on this display protocol; the plurality 
of images is displayed on the display means . The display protocol 
defines the layout of a plurality of images, the display 
conditions (for example, in what order images are to be displayed , 
etc.), the image processing conditions (hereinafter referred 

15 to as the layout, etc.) ; based on the examination, the series, 
the examining doctor or group of doctors, the place where the 
images are to be employed, the purpose for which the images are 
to be used, etc. For example, a given display protocol might 
be defined so that a screen is divided into four regions in which 

20 are displayed: in the upper left region, a front view X-ray image 
of the chest taken during the current examination; in the lower 
left region, a front view X-ray image of the chest taken in the 
past; in the upper right region, a side view X-ray image of the 
chest taken during the current examination; and in the upper 

25 right region, a side view X-ray image of the chest taken in the 
past. In addition, another display protocol might be defined 
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so that a screen is divided into 9 regions in which a plurality 
of Tomography images obtained by a CT apparatus are lined up 
and displayed. 

Further, although a display protocol is not employed, a 
5 method has been provide wherein each series (by type of 

examination) of images obtained in an examination employing MR I 
apparatus is lined up and displayed, and at the same time one 
series of images is switched, another series of images is also 
switched (refer to US Patent No. 5,452,416) . According to this 

10 method, the examiner of images encounters no impediments in 
viewing of the images, and multiple series of images can be 
assigned to correspond to each other and displayed. 

As examinations become more complex and the number of 
images increases, if only one display protocol is defined, it 

15 becomes difficult to display the images so that diagnosis can 
be performed without difficulty. Because of this, a plurality 
of display protocols is prepared, and the examiner switches the 
protocols in order, so that the plurality of images is displayed 
in the desired display layout. However, in this method of 

20 switching protocols a great burden is placed on the examiner 
in that he or she must memorize the type of layout defined by 
each display protocol. In addition, because it is necessary to 
specify the display protocol each time the layout is switched, 
the efficiency of displaying the images is extraordinarily low. 

2 5 SUMMARY OF THE INVENTION 

The present invention has been developed in consideration 
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of the circumstances described above. A main objective of the 
present invention is to provide an image display method, 
apparatus and computer readable storage medium on which a program 
that causes a computer to execute the image display method is 
5 recorded, which can display with high efficiency a plurality 
of images. 

In the image display method of the present invention for 
displaying a plurality of images on a display means, the display 
layout is switched by switching the display protocols, based 

10 on at least one display protocol sequence in which a plurality 
of display protocols that define a display layout are lined up 
in a predetermined order, and the plurality of images are 
displayed on the display means. 

The expression "display means" refers to a CRT, LCD, etc 

15 monitor for displaying images. 

The expression "display protocol" refers the protocol 
which defines image layout, image display conditions, image 
processing conditions, etc. , based on an examination, a series, 
the examining doctor or group of doctors, the place an image 

20 will be used and/or the purpose of the image, etc. More 

specifically, a definition by which a screen is divided into 
four regions in which are displayed a front view X-ray image 
of the chest taken during the current examination in the upper 
left region, a front view X-ray image of the chest taken in the 

25 past in the lower left region, a side view X-ray image of the 
chest taken during the current examination in the upper right 
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region, and a side view X-ray image of the chest taken in the 
past in the upper right region, or alternatively, a definition 
by which a screen is divided into 9 regions in which a plurality 
of Tomography images obtained by a CT apparatus are lined up 
5 and displayed, or a definition by which projection images and 
cross -sectional images obtained by a CT apparatus are lined up 
and displayed, or a definition by which cross - sectional images 
obtained by a CT apparatus are able to be switched and displayed, 
or a definition by which for images Tl and T2 obtained by an 

10 MRI apparatus in a special examination mode, a display screen 
may be dived up and images displayed based on whether or not 
a contrast medium was used when an image was taken, etc., may 
be employed as display protocols. 

The expression "display protocol sequence" refers to an 

15 array of display protocols lined up in a predetermined order. 
Note that the display protocols in a display protocol sequence 
are 1 ined up in an order according to the examination, the series , 
the examining doctor or the group of doctors the examining doctor 
belongs to, etc. 

20 Moreover, switching of display protocols may be carried 

out manually or automatically. 

Note that there may be only one display protocol sequence, 

however, for cases in which there are multiple display protocol 

sequences, it is desirable that it is possible to select one 
25 display protocol from said multiple protocols, and to have the 

plurality of images displayed on the display means based on the 
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selected display protocol sequence. 

In addition, when there are multiple display protocol 
sequences, they may be switched, and the plurality of images 
displayed, based on the display protocol sequence switched to, 
on the display means. 

Further, the display protocol sequence can be set in 
advance, or it can be created based on the predetermined 
conditions when the images are displayed on the display means. 

As the "predetermined conditions" , the type of examination, 
the series, the examining doctor or the group of doctors the 
examining doctor belongs to, etc. may be employed. 

The image display apparatus of the present invention for 
displaying a plurality of images on a display means is provided 
with a memory means for remembering at least one display protocol 
sequence, in which a plurality of display protocols that define 
a display format are lined up in a predetermined order, and a 
control means for controlling the switching, based on at least 
one display protocol sequence, of display layouts by the 
switching of display protocols. 

For cases in which multiple display protocol sequences are 
remembered by the memory means of the display apparatus of the 
present invention, an input means is provided for receiving 
selection of a desired display protocol sequence. 

That aforementioned control means displays, based on the 
display protocol sequence selected in the input means, on the 
display means the plurality of images is desirable. 



In addition, that the control means of the display 
apparatus of the present invention can also switch the multiple 
display protocol sequences, and based on the display protocol 
switched to, display the plurality of images is desirable. 

Furthermore, that the control means of the image display 
apparatus according to the present invention creates the display 
protocol sequence based on the predetermined conditions, and 
displays the plurality of images on the display means based on 
the created display protocol sequence is desirable. 

Note that image display method of the present invention 
may be provided as a program that causes a computer to execute 
the image display method of the present invention recorded on 
a computer - readable storage medium. 

According to the present invention, based on a display 
protocol sequence in which a plurality of display protocols have 
been lined up in a predetermined order, the display layout of 
a plurality of images can be switched; therefore, it is not 
necessary for the examiner to memorize the display protocols, 
and the work load of the examiner is thereby reduced. 

Further, for cases in which there are multiple display 
protocol sequences, because a desired display protocol sequence 
can be selected, the degree of freedom with respect to image 
display format is raised. 

Additionally, for cases in which there is are multiple 
display protocol sequences, because the display protocol 
sequence can be switched, the examiner can display the plurality 



of images according to a desired display protocol sequence. 
BRIEF DESCRIPTION OF THE DRAWINGS 
Figure 1 is a block drawing of the configuration of a 
medical image network, in which the display apparatus according 
to a preferred embodiment of the present invention is 
implemented, 

Figure 2 is a block diagram showing the detailed 

configuration of a workstation. 

Figure 3 shows examples of display protocols, 

Figure 4 shows the display protocol sequence selection 

screen, and 

Figure 5 is a flowchart of the operation of a preferred 
embodiment . 

DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Hereinafter, with reference to the drawings, the preferred 
embodiments of the present invention will be explained. 

Figure 1 is a block drawing of the configuration of a 
medical image network, in which the display apparatus according 
to a preferred embodiment of the present invention is implemented . 
As shown in Fig. 1, this medical image network comprises an image 
server 1 storing image data S and a workstation 2 connected 
by a network 3. In such a medical image network, by workstation 
2 accessing image server 1 and specifying that image data stored 
in image server 1 be transmitted, or by workstation 2 reading 
out from image server 1 image data stored from workstation to 
mage server 1, images can be displayed at workstation 2 and 



diagnosis performed. Note that in Fig. 1, although only one 
workstation is shown, multiple workstation 2's are connected 
to image server 1 by network 3 . 

Image server 1 is provided with : a temporary storage medium 
11, such as a RAID (Redundant Array of Inexpensive Disks) , etc. 
for temporarily storing image data S ,- an archive disk 12, such 
as a CD-R, DVD, DLI , etc. for providing semi -permanent storage 
of image data S after a specified period of time has elapsed; 
and a server computer 13 for controlling data - compression 
processing of image data S, data management, data transmission 
from workstation 2 , and various operations and processes of image 
server 1. Further, image server 1 is connected to an input 
modality 4 such as CR apparatus, CT apparatus, MRI apparatus, 
etc. , from which it receives formed image data S, which it stores 
and manages . 

Note that, according to the set conditions (after a 
predetermined period of time elapses after diagnosis by a doctor 
has been performed, for example) , image data S is copied from 
temporary storage medium 11 to archive 12 . For example, when said 
set conditions are satisfied, the exact same image data S as that 
stored in temporary storage medium 11 is copied to archive 12, 
and as the amount of storage space on temporary storage medium 
11 becomes unavailable for use, said image data S is deleted from 
temporary storage medium 11 in the order commencing from the 
oldest date thereof, whereby said image data S becomes stored 
exclusively in archive 12. Note that according to the purpose 



of image data S, it may be compressed and stored in both temporary 
storage medium 11 and archive 12. In addition, original image 
data or original image data that has been compressed and is 
extrac table can be stored in temporary storage medium 11, and 
when said image data is copied to archive 12 it can be made 
undecompressible . 

Further, copying data S to archive 12 and deleting data 
S from temporary storage medium 11 are managed by the database 
DB, which is not shown in the drawings. Accordingly, if a request 
for image data S that has been deleted from temporary storage 
medium 11 is issued by display terminal 2, said image data is 
read out from archive 12 and transmitted to display terminal 2. 
In this case, although more time is required for such reading 
out and transmitting from archive 12, compared to cases in which 
image data S is transmitted to display terminal 2 from temporary 
storage medium 11, the image represented by image data S can be 
displayed by display terminal 2 without recognition of the 
storage location of said image data S. 

Workstation 2 is provided with: a computer 21; a CRT, LCD, 
etc. monitor 22; and a keyboard, mouse, etc. input means 23. 
By various input operations of input means 23, image data S can 
be acquired from image server 1 and images displayed on monitor 
22 . 

Next, the image display method for displaying images on 
monitor 22 of workstation 2 will be explained. Figure 2 is a 
block diagram showing the detailed configuration of a 



workstation. As shown in Fig. 2, workstation 2 is provided with 
a controller 27 and a memory 28. Note that in the current 
embodiment two monitors, 22A and 22B are used for displaying 
images. In addition, controller 27 and memory 28 are provided 
5 in Fig. 2 for explanation purposes, however; actual processing 
is carried out by use of software installed in computer 21. In 
memory 28, multiple display protocol sequences PS, in which 
multiple display protocols P defining multiple display layouts 
are lined up in a predetermined order, are remembered. 
10 Fig. 3 shows the display layouts according to each type 

of display protocol . Note that in the current embodiment, images 
obtained by a CT apparatus are displayed. More specifically, 
in a CT apparatus, two images are taken of the same position: 
one of the images has shadowed structures, and the other image 
15 does not. Generally, there is set of projection images (called 
"scout views") composed of a projection image having shadowing 
and a projection image not having shadowing, and a set of 
cross - sectional images composed of a cross - sec tional image 
having shadowing and a cross - sectional image not having 
20 shadowing, for a total of two sets of images. Each of the two 
sets of images obtained in this way are grouped so that there 
is a group containing an image SI (projection image with 
shadowing), and an image S2 (cross - sectional image with 
shadowing) , and a group containing an image S3 (projection image 
25 without shadowing), and an image S4 (cross - sectional image 
without shadowing) . Here, there is only one image for each 
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projection image; however, each cross - sec tional image has 36 
images, corresponding to the slice position, which are 
represented by S2 and S4 . Note that images S1-S4 represent images 
obtained in the current examination. 
5 In addition, the patient subjected to the current 

examination was subjected to an identical examination a week 
before (hereinafter referred to as a past examination) , and for 
the past examination, a group of images containing an image Ol 
(projection image with shadowing), and an image 02 (cross - 
10 sectional image with shadowing) , and a group containing an image 
03 (projection image without shadowing), and an image 04 
(cross-sectional image without shadowing) were obtained. The 
number of images is the same as for S1-S4. 

Furthermore, X-ray images of a front view and a side view 
15 of the chest of this patient were also obtained. 

First, the examining doctor performs a brief examination 
of the images obtained in the current examination. In this case, 
as shown in Fig. 3(a), the display screen of monitors 22A and 
22B are each divided into 9 sections, and image S2 is displayed 
20 first, followed by image S4 . Here, images S2 and S4 each have 
36 cross-sectional images, however, because only 18 images can 
be displayed at one time on monitors 22A and 22B, according to 
a switching operation of input means 23, the displaying of all 
the images is split into two times and carried out. This type 
25 of image protocol is designated as PI. 

Next, for cases in which images obtained in a past 
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examination are to be compared to images obtained in the current 
examination, the display screen of monitors 2A and 22B are each 
divided into four sections and each of the images are displayed: 
in region Al, image SI; in region A2 , image S2; in region S3, 
image 01; in region A4 , image S4 ; in region Bl, image S3; in 
region B2 , image S4; in region B3, image 03; and in region B4 , 
image 04 . Here, image SI has only one image, but image S2, S4, 
02 and 04 each have 6 cross - sectional images, therefore, by 
employing input means 23, the images are sent in order or in 
reverse order, according to the number assigned to each mage 
(generally, the slice order, in other words, the order of the 
slice position) , and switched and displayed. Further, a mark 
for showing what is called the referencing position of the 
cross-section is displayed in images SI, S4, Ol and 04 . In this 
way, it is possible to see which position of the cross - sectional 
positions of images SI, S4, 01 and 04 is currently being displayed . 
This type of display layout is called a stack display, and by 
displaying such a stack display it is possible to compare image 
S2 to image 02, and image S4 to image 04; that is to say, comparing 
the images obtained in the past examination to the images 
obtained in the current examination is easy to perform. In 
addition, if switching of the images of the past examination 
and images of the present examination is carried out at the same 
time, by switching only the images on one side, because the images 
on the other side are also sent in order, it is easy to compare 
the images on both sides. This type of image protocol is 



designated as P2 . 

Next, when comparing the CT images and the chest X-ray 
images, the display screen of monitor 2A is divided into four 
sections, and the display screen of monitor 22B is divided into 
2 sections and each image is displayed: on monitor 22A, in region 
Al, image SI; in region A2 , image S2 ; in region A3, image S3; 
in region A4 , image S4 ; and on monitor 22B, in region Bl, the 
front view chest X-ray image; in region B2, the side view chest 
X-ray image. This type of image protocol is designated as P3 . 

Display protocol PS1 is composed of aforementioned display 
protocols PI, P2 and P3, lined up in that order, display protocol 
PS2 is composed of aforementioned display protocols PI, P2 and 
P3, lined up in the order PI, P3 , P2, and display protocol PS3 
is composed of aforementioned display protocols PI, P2 and P3, 
lined up in the order P2, PI, P3 . 

Note that for such display protocol sequences PS, there 
is a selection screen displayed on monitors 22A and 22B as shown 
In Fig. 4, from which it is possible to select by clicking with 
the mouse, a desired display protocol sequence PS. Further, at 
this time, it is beneficial that the display protocol sequence 
be selected corresponding to the examination, the series, the 
type of input modality 4 in which the images were formed <CR 
images, CT images, MR I images, etc.), the examining doctor or 
group of doctors to which the examining doctor belongs {reading 
doctor, clinical doctor, referring doctor, etc.) the place where 
the images are to be employed (an examination room, a doctor's 
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residence, etc.), the purpose for which the images are to be 
used, (reading, reference, comparison, etc.), etc. 

Then, by selecting the display protocol sequence from 
these type of display protocol sequences, controller 27 displays 
5 images on monitors 22A and 22B in the layout corresponding to 
the order of the display protocols in the selected display 
protocol sequence. 

Next, the operation of the current embodiment will be 
explained. Figure 5 is a flowchart of the operation of the current 

10 embodiment. First, the doctor who is the examiner of images on 
of workstation 2, using the input means 23, selects a display 
protocol sequence for use when images are displayed on monitors 
22A and 22B (Step SI) , and at the same time specifies that image 
server 1 transmit the image data S to be displayed (Step S2) . 

15 Note that in the current embodiment, the display protocol 

sequence PS1 selected is to be PS1 . Accordingly, image data S 
is transmitted by image server 1 over network 3 to workstation 
2 (Step S3) . When controller 27 receives transmission of image 
data S, the selected display protocol sequence is read out from 

20 memory 28, and at first, based on to the first display protocol 
PI, the layout is performed and the laid out images are displayed 
on monitors 22A and 22B. 

Next, by pressing a function key, clicking on the screen 
with the mouse, etc. a check is conducted (Step S5) to determine 

25 whether or not switching of the display protocol sequence has 
been specified, and if a yes is registered in Step S5, a check 
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to determine whether or not the current display protocol 
displaying the images is the last display protocol, P3 , of the 
selected display protocol sequence PS1 (Step S7) . If a no is 
registered in Step S7 , layout is performed using the next display 
5 protocol in order after PI, that is P2 , and the images of the 
next layout are displayed on monitors 22A and 22B (Step 28) , 
and Step S5 is returned to. 

Further, when the display protocol sequence is switched, 
layout is performed using the next display protocol, P3, and 
10 the images of the next layout are displayed on monitors 22A and 
22B. 

On the one hand, if a no is registered in Step S5, a check 
is conducted to determine whether or not switching of the display 
protocol has been specified (Step S6) , and if a yes is registered 

15 in Step S6, the display protocol sequence is switched from the 
display protocol sequence selected in Step SI, PS1, to the 
specif ied display protocol sequence (PS2, for example) , and Step 
4 is returned to; layout is performed using the first display 
protocol of the switched to display protocol sequence, and the 

20 images displayed. Note that if a no is registered in Step S6, 
Step S5 is returned to and Steps S5 and S6 are repeated. 

In addition, if a yes is registered in Step S7, Step 4 is 
returned to and the images are laid out according to the first 
display protocol PI and displayed. In this way, each time 

25 switching of the display protocol is performed, the display 
protocols are switched in the order PI, P2 , P3, PI, etc., and 
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the images laid out and displayed on monitors 22A and 22B. 

In this way, because in the current embodiment, based on 
display protocol sequence PS1, in which the plurality of display 
protocols PI, P2, and P3 are lined up in a predetermined order, 
5 the display format can be switched, the examiner of images at 
workstation 2, by performing only the simple operation of 
switching the display protocols in a simply defined sequence, 
can switch the display layout of images displayed on monitors 
22A and 22B. Accordingly, the examiner of images does not have 

10 to memorize the display protocols, and his or her workload is 
thereby reduced. 

Further, for cases in which there are multiple display 
protocol sequences, because the display protocol sequence can 
be switched, the examiner of images can display the plurality 

15 of images according to a desired display protocol sequence. 

Note that in the current embodiment, as shown in Fig. 3, 
the display layout of the images is switched using display 
protocols that define display layouts, however; display 
protocols may be defined for each type and level of multiple 

20 image processing processes, and the image display format changed 
according to display protocol sequences in which the multiple 
display protocols are lined up. For example, by using a display 
protocol sequence in which various display protocols for 
changing the intensi ty - level processing are lined up in a 

25 predetermined order, images having different intensity levels 
can be switched in order and displayed. 
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Further, in the current embodiment, the display protocols 
are switched by specifying the switching, it is also possible, 
for example, that display protocols be switched every so many 
seconds, etc., or automatically. 

In addition, although in the current embodiment the 
display protocol sequence is selected in advance, the display 
sequence may also be created automatically corresponding to the 
examination, the series, the type of input modality 4 in which 
the images were formed (CR images, CT images, MRI images, etc.) , 
the examining doctor or group of doctors to which the examining 
doctor belongs (reading doctor, clinical doctor, referring 
doctor, etc.) the place where the images are to be employed (an 
examination room, a doctor's residence, etc.), the purpose for 
which the images are to be used, (reading, reference, comparison, 
etc.), etc. In this case, the display format is switched 
according to the generated display protocol sequence. 
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